Intermediate Data Engineer

About

Description

Proactively collect business requirements using a variety of methods such as interviews, document analysis, workshops, and workflow analysis to express the requirements in terms of target user roles and goals, in order to garner the "why" of the requirements and the benefits of such requirements.

Responsibilities

• Build Pipelines: Build and maintain pipelines to meet business data needs by ensuring data is reliable, accessible, and aligned with strategic goals
• Data Champion: Understand the data needs of various business areas and guide in the use of data sources for reporting, management of dashboards, and scorecards
• Data Quality: Must ensure data is correct, complete, consistent, up-to-date, valid, unique, and easy to track, while maintaining system reliability, accessibility, minimizing redundancy, documenting processes, and automating checks to ensure high-quality data
• Security: Must ensure data security by implementing strong access controls, encryption, authentication, and compliance with regulations to protect sensitive data throughout the pipeline
• Stakeholder Management: Be responsive to stakeholder feedback, and continuously optimizing processes to share reporting data with our partners to meet evolving customer needs within agreed timelines Service Levels: Collaborate and work with the Analytics, Distribution, Underwriting, Actuarial, Claims, Finance, HR, IT and other teams to deliver required service levels

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or a related field
• 3–5 years of hands-on experience in designing data models, performing data transformation, and ensuring data quality through validation and analysis
• Proficient in Python, SAS, and SQL, with strong expertise in Apache Spark (PySpark/Spark SQL) and Databricks for big data processing
• Experienced in using Git for version control and implementing CI/CD pipelines, along with tools like Terraform for managing infrastructure-as-code
• Solid understanding of data architecture, including data lakes, data warehouses, and BI platforms
• Strong logical problem-solving abilities and excellent verbal and written communication skills for effective collaboration with teams and stakeholders

Application instructions:

• The appointment will be made from the designated group in line with the Employment Equity Plan of Old Mutual South Africa and the specific business unit in question. Old Mutual Limited is pro-vaccination and encourages its workforce to be fully vaccinated against Covid-19. All prospective employees are required to disclose their vaccination status as part of the recruitment process.